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ABSTRACT 

One  of  the  fvindamental  questions  In  nonlinear  optimization  is  how 
optimization  problems  behave  when  the  functions  defining  them  change  (e.g>,  by 
continuous  deformation).  Recently  the  study  of  epl-continulty  has  somewhat 
unified  the  results  In  this  area.  Here  we  show  how  to  localize  the  concept  of 
epi-contlnuity/  and  how  to  apply  these  localized  ideas  to  ensure  persistence 
and  stability  of  local  optimizing  sets.  We  also  show  how  these  conditions 
follow  from  known  properties  of  nonlinear  programming  proble..iS. 
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SIGNIFICANCE  AND  EXPLANATION 


Many  real-world  problems  In  statistics,  engineering,  economics  and  other 
areas  require  the  solution  of  optimization  problems.  Often  these  problems 
involve  nonlinear  functions,  and  when  this  is  the  case  we  can  frequently  find 
only  local  solutions  (i.e.,  we  know  that  there  is  no  better  solution  near  the 
solution  point  that  we  have  found,  but  we  are  not  sure  what  happens  far 
away).  Also,  these  problems  are  often  subject  to  small  changes  in  the  problem 
data  caused  by,  e.g..  Inaccurate  information  or  problem  evolution  in  time. 

Once  we  have  found  a  local  solution,  it  is  natural  to  ask  whether  there  will 
still  be  a  local  solution  nearby  if  the  problem  data  are  slightly  changed. 

This  paper  develops  an  appropriate  theoretical  framework  within  which 
this  question  can  be  analyzed,  and  it  provides  relatively  simple  and 
verifiable  conditions  under  which  local  solutions  will  persist  in  the  sense 
just  described. 


The  responsibility  for  the  wording  and  views  expressed  in  this  descriptive 
summary  lies  with  MRC,  and  not  with  the  author  of  this  report. 


LOCAL  EPI-CONTINUITY  AND  LOCAL  OPTIMIZATION 


Stephen  M.  Robinson 


1.  Introduction. 

The  question  of  stsbillty  in  optimization  deals  with  what  happens  to  an  optimization 
problem  when  the  elements  of  the  problem  are  in  some  way  deformed.  For  example,  if  the 
original  problem  had  optimal  solutions,  one  might  ask  whether  the  perturbed  problem  has 
solutions  (persistence)  and,  if  so,  whether  they  are  in  some  sense  close  to  those  of  the 
original  problem  if  the  deformations  are  in  some  sense  small  (stability).  In  general  the 
answers  to  these  questions  are  "no*  and  "no,"  so  people  have  tried  to  find  conditions  to 
impose  on  the  optimization  problem  so  that  the  answers  become  "yes"  and,  frequently,  so 
that  the  solutions  are  somehow  well  behaved  as  functions  of  the  perturbation  parameters. 

A  comprehensive  overview  of  much  wor)c  in  parametric  optimization  is  given  in  the  l>ook  by 
Bank  ^  al.  (21 . 

Recent  development  of  the  theory  of  epl*convergence  has  unified  many  of  the 
approaches  and  results  in  stability  analysis.  A  general  survey  of  results  in  this  area 
may  be  found  in  11],  and  a  general  Introduction  in  (&]. 

In  this  paper  we  show  how  to  localize  certain  results  found  in  the  theory  of  epl- 
convergence,  and  how  to  use  these  localized  results  to  develop  useful  criteria  for 
persistence  and  stability  of  local  minimizers.  Moreover,  we  show  that  these  criteria  are 
implied  by  assumptions  cocusonly  used  in  optimization,  such  as  constraint  qualifications 
and  second-order  sufficient  conditions.  Ihus,  the  results  presented  here  can  be  applied 
whenever  these  assumptions  Ix^ld. 


Sponsored  by  the  United  States  Army  under  Contract  No.  DAAG29-80-C-004 1  and  by  the  U.s 
National  Science  Foundation  under  Grant  No.  MCS-8200632,  Mod.  2,  at  the  University  of 
Wisconsln-Hadison.  The  first  version  of  this  paper  was  written  at  the  International 
Institute  for  Applied  Systems  Analysis,  Lsxenburg,  Austria,  during  the  author's  visit 
there  In  May  and  June  of  1983. 


The  basic  technique  used  in  this  paper  is  a  generalization  of  the  method  used  in  (6, 
Th.  3.1]  to  prove  existence  of  solutions  to  smooth  nonlinear  programming  problems  whose 
data  are  perturbed.  The  results  given  here,  however,  apply  to  much  more  general  problems 
in  which  no  differentiability  need  be  assumed. 

The  remainder  of  this  paper  is  organized  as  follows:  in  Section  2  we  develop  the 
local  epi-continuity  results  that  we  shall  need  here,  and  in  Section  3  we  apply  these  to 
study  global  solutions  of  perturbed  minimization  problems.  Of  course,  similar  results  can 
be  applied,  mutatis  mutandis,  to  maximization  problems.  Then  in  Section  4  we  introduce 
the  local  optimization  problem  whose  solutions  we  want  to  study,  and  we  employ  the  results 
of  Section  3  to  develop  criteria  for  persistence  and  stability  of  its  local  mlnimizers. 
Finally,  in  Section  5  we  show  how  commonly  used  assumptions  about  nonlinear  optimization 
problems  imply  the  general  criteria  used  in  Section  4. 
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2.  Local  epl-contlnulty . 


The  ideas  of  epi-cont. inuity  and  epi-converqence  of  functions  have  recently  been  used 
to  unify  and  extend  the  study  of  variational  problems)  for  further  information  and 
references  consult  [1]  or  (8J.  Here  we  develop  a  local  version  of  epi-continuity  and 
establish  some  of  its  properties* 

In  order  to  deal  with  the  presence  of  parameters  in  the  functions  we  use,  it  will  be 
convenient  to  employ  functions  of  the  form  f(p,x),  where  p  is  understood  to  be  a 
parameter  in  a  topological  space  P,  and  for  each  p  the  function  f(p,*)  is  the  object 
of  Interest  for  minimization  or  other  purposes.  We  shall  deal  with  the  behavior  of 

f(p,*)  for  p  near  some  base  value  Pq.  We  can  Include  the  case  of  sequences  in  this 

framework  by  taking  P  to  be  the  standard  one-point  compactif ication  of  {0,1,2,...} 
created  by  adjoining  the  point  pq  =  *,  with  a  base  of  neighborhoods  of  *  given  by 
Vji  {n,n+1,...}  U  {*}  tor  n  =  0,1,2,...  . 

In  the  situations  we  want  to  consider,  the  question  of  interest  is  to  relate  various 
properties  of  f(p,*)  to  the  corresponding  properties  of  f(pg,»)  as  p  converges  to 
Pq.  To  work  with  such  problems  we  need  an  appropriate  concept  of  convergence  for 
functions.  Of  course,  ordinary  pointwise  convergence  is  available,  but  it  is  not 

particularly  convenient  for  the  study  of  minimization  problems.  A  more  useful  idea  is 

epi-convergence,  which  permits  us  to  employ,  in  the  definition  of  the  limit  of  f(p,*) 
at  Xq,  information  not  only  about  f(p,XQ)  for  p  near  pq  but  also  about  f(p,x) 
for  X  near  xq.  For  our  purposes  it  is  convenient  to  introduce  epi-convergence  by  means 
of  two  auxiliary  functions  associated  with  f;  we  define  these  next.  For  the  moment  we 
allow  X  to  take  values  in  an  arbitrary  topological  space  X;  in  Section  3  we  shall 
specialize  X  to  a  portion  of  S".  We  use  W(x)  op  N(p)  to  denote  the  neighborhood 
system  of  x  or  p.  All  functions  used  here  will  be  extended-real- valued,  taking  values 
in  K  or  sometimes  in  <-“,+•).  Hie  effective  domain  of  such  a  function 

(abbreviated  "dom")  is  simply  the  set  of  points  at  which  the  function  does  not  take  the 
value  +*“.  Also,  for  any  function  a  :  P  ♦  R,  we  set 


-3- 


and 


lim  inf  a  :=  sup  inf  a(p) 

p>p-  ueW(pQ)  peu 

llm  sup  a  :=  inf  sup  a(p)  . 

p>Pq  ueM(pQ)  peu 

DEFINITION  2.1:  Let  P  and  X  be  topological  spaces  and  let  f  :  P  ^  X  +  R.  For 

Pq  e  P  and  Xq  €  X,  the  epl-limit  inferior  of  f  at  Xq  as  p  ♦  Pq  is 

(E*f)(XQ)  sup  lim  inf  inf  f(p,x) 

veMCXp)  p>pp  xev 

and  the  epi-limlt  superior  of  £  at  Xq  as  p  ♦  Pg  is 

(E*f)(xQ)  :=  sup  Itm  sup  tnf  f(p,x)  . 

veN(Xjj)  p+Pq  xev 

For  more  discussion  o£  these  functions,  see  (8). 

Evidently  E«f  S  E*f,  but  these  two  functions  may  not  agree  at  any  given  x.  The 
set  (possibly  empty)  of  x  where  they  do  agree  is  called  the  domain  of  epl-continuity  of 
f(p,*),  written  and  on  this  set  we  define  the  epi-limit  of  f  as  p  ♦  pg  to 

be  their  common  value : 

Ef(x)  =  E»f(x)  =  E*f(x),  for  X  e  t>g(f)  . 

The  names  given  to  E*f  and  E  f  suggest  using  them  to  define  a  kind  of 
semicontinuity.  We  do  this  in  the  next  definition. 

DEFINITION  2.2:  Let  £,  pg  and  Xq  be  as  in  Definition  2.1.  We  say  f  is  epi- 
lower  semicoi.tinuous  (e-lsc)  at  Xg  as  p  ♦  pg  if  f(pg,Xg)  f  E*f(Xg),  and  epi-upper 
semicont inuous  (e-usc)  there  if  f(pg,Xg)  i  E*f(xg),  whereas  f  is  epi-continuous  at 
Xg  if  it  is  both  e-lsc  and  e-usc  there. 

If  f  is  epi-continuous  at  a  point  Xg  then  clearly  Xg  e  Pg(f),  but  the  converse 
is  false  in  general.  However,  a  simple  condition  on  f(pg,*)  removes  this  difficulty. 

We  state  this  after  the  following  proposition. 
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PROPOSITION  2.3:  Let  f,  pg,  and  Xq  be  as  In  Deflnttton  2.1.  Then 
Itm  sup  f(p,x)  i  E*{(Xq)  i  lim  tnf  f(pg,x)  >  lia  tnf  f(p,x)  «  E,: 

(p.>«>*tPg,Xg)  x-*Xq  (P/>‘)*(Pg.Xo) 

PROOF:  Choose  two  members  V,  and  Vj  of  M(xq).  Rs  xg  6  V,  O  V2, 
any  p  e  P 

sup  g(p>x)  ^  inf  g(p>x)  , 

xev^  xev2 


and  therefore 


inf  sup  sup  g(p>x)  2  Inf  sup  Inf  g(p.x)  . 

ueKXpg)  peu  xev^  ueN(pg)  peu  xeu2 


Taking  the  inflmua  over  e  M(Xg)  on  the  left  and  the  supreraum  over  V2 
right,  we  obtain  the  first  inequality.  For  the  second,  note  that  for  each 
each  V  e  Al(xg)  we  have 

sup  inf  f(p,x)  >  inf  f(p.,x)  . 
pOT  xev  xev  “ 


Hence 


inf  sup  tnf  f(p,x)  2  inf  f(pn,x)  , 

c/eW(pg)  peu  xev  xev 


and  upon  taking  the  supremum  in  V  we  get 


E  f(xg)  2  sup  inf  f(pg,x)  “  lim  tnf  f(pQ,x) 

VeWxg)  xev  “  ^+Xg 


which  proves  the  second  Inequality.  The  third  is  trivial,  and  the  equality 
follows  from 

E«f(xn)  ~  sup  lin  inf  inf  f(p,x) 
veWxg)  p*p  xev 


sup  sup  inf  inf  f(p,x)  >  lim  inf  f(p,x) 

veMxg)  ueW(pg)  peu  xev  (p,x)MPo.Xg) 


(Xg).  (2,1) 

we  have  for 


!  N(xg)  on  the 
U  e  N(pg)  and 


on  the  right 
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COROLLARY  2.4:  Let  f,  Pq,  and  Xq  be  as  in  Definition  2.1,  and  suppose  ) 

is  Isc  at  Xq.  Then  the  set  of  points  at  which  f  is  epi-continuous  is  precisely 

PROOF:  If  f  is  epi-continuous  at  some  point,  we  already  know  that  point  is  in 

Now  suppose  Xq  belongs  to  p£(f),  so  that  E*f(xQ)  =  E  f(xQ).  Then  by  (2.1) 
this  common  value  is  lim  inf  f(pQ,x).  But  by  hypothesis  this  is  f(pQ,XQ),  and  thus 

X>Xq 

f  is  epi-continuous  at  Xq.  ■ 

COROLLARY  2.5:  Let  f,  Pq,  and  Xq  be  as  in  Definition  2.1.  Then  f  is  epi-lower 

semlcontinuous  at  Xq  if  and  only  if  f  is  lower  semlcont inuous  at 

PROOF:  E*f(xQ)  =  lim  inf  f(p,x)-  ■ 

(P,x)>(P(j,Xq) 

COROLLARY  2.6;  Let  f  and  g  be  functions  from  P  x  X  to  { -*»,+“],  and  let 

(pQ,Xo)  e  P  X  X.  f  and  g  are  epi-lower  semicontlnuous  at  Xq,  then  so  is  f  +  g. 

PROOF:  f  +  g  IS  well  defined  since  neither  function  takes  Now  use  Corollary 

2.5  and  the  fact  that  addition  preserves  lower  semicontinuity.  ■ 

These  results  show  that  epi-lower  semicontinuity  behaves  very  simply  under  addition, 
being  nothing  more  than  ordinary  lower  semicontinuity  in  disguise.  This  is  not  true  of 
epl-upper  semicontinuity,  though,  since  the  first  inequality  in  (2.1)  may  be  strict. 
However,  the  implication  holds  in  one  direction. 

COROLLARY  2.7:  Let  f,  Pq,  and  Xq  be  as  in  Definition  2.1.  If  f  is  upper 

semlcontinuous  at  then  f  is  epl-upper  semlcontinuous  at  Xq. 

PROOF:  Use  Proposition  2.3.  ■ 

This  result  differs  from  Corollary  2.5  In  that  its  converse  is  not  true  (take 
P  =  X  -  R  with  g(p,x)  =1  if  x  is  irrational  and  0  if  x  is  rational).  One 
consequence  of  this  discrepancy  is  that  the  sum  of  two  epi-usc  functions  need  not  be  epi- 
usc.  To  see  this,  take  g(p,x)  to  be  as  in  the  last  sentence,  with 
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0  if  p  »  0  and  x  “  0  , 

1  if  p  ^  0  and  x  =  0  , 

h(p,x)  *  ■ 

1  if  X  is  rational  but  not  zero  , 

0  if  X  is  irrational  . 

If  we  choose  any  p  and  any  V  e  H(0),  we  have  inf  h(p,x)  -  0;  hence 

xev 

E  h(0)  »  0  "  h(0,0),  so  h  is  epi-usc  at  0.  However,  (g  +  h)(p,x)  is  0  at  (0,0) 

and  1  everywhere  else,  so  if  p  0  then  for  any  V  e  W(0>  one  has  inf  g(p,x)  «  1. 

xev 

Thus  E  (g  +  h)(XQ)  -I,  so  g  +  h  is  not  epi-usc  at  0.  Therefore  the  analogue  of 
Corollary  2.6  does  not  hold.  However,  by  strengthening  the  hypothesis  somewhat  one  can 
obtain  a  condition  for  epi-usc  of  g  +  h,  as  we  now  show. 

PROPOSITION  2.8:  Suppose  that  g  and  h  are  functions  from  P  x  x  to 
and  that  (Po,Xq)  e  P  x  x.  Let  h  be  epi-usc  at  Xq.  _I£  g  is  use  at  (pq,Xq) 
relative  to  dost  h,  then  g  +  h  is  epi-usc  at  Xq. 

PROOF:  If  (g  +  h)(pQ,XQ)  “  +*»  then  the  result  is  true,  so  we  can  assume 

(pQ,Xo)  e  doo  g  n  dom  h.  Choose  e  >  0;  it  suffices  to  prove 

E*(g  +  h)(XQ)  J  (g  +  hXpg.Xg)  +  £. 

Since  g  is  use  at  (pQ,Xg)  relative  to  dom  h,  there  exist  Ug  8  V(pg)  and 
Vg  e  N(Xg)  such  that  If  (p,x)  €  (Ug  x  Vg)  n  dom  h  then  g(p,x)  <  g(pg,Xg)  +  e  <  +». 

Also,  we  )inow  that  h(pg,XQ)  j  E*h(xg),  so  for  each  V  8  N(Xg)  there  is  some  t  8  ,^J(pg) 

such  that  for  each  p  8  0  there  exists  xev  with 

h(p,x)  <  h(pg,Xo)  +  ^  E  <  -H-  .  (2.2) 

Now  choose  U  8  ^(Pg)  and  V  e  W(Xq)  with  U.  C  Ug  and  V  C  Vg.  If  p  8  U,  there 

is  some  x  8  V  satisfying  (2.2),  and  the  pair  (p,x)  then  belongs  to  dom  h. 

Therefore  (g  +  h)(p,x)  <  (g  +  h)(pg,Xg)  +  e,  so 

sup  inf  (g  +  h)(p,x)  i  <g  +  h)(pn,xg)  +  £  .  (2.3) 

peu  xev 

Since  talking  sup-inf  over  V  C  Vg  and  U  C  Ug  is  equivalent  to  taking  sup-inf  over 
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^(Pq)  ^  W(xq),  we  have  from  (2.3) 

E*(g  +  h)(xQ)  i  (g  +  h)(pQ,XQ)  +  £  .  ■ 

Proposition  2.8  leads  to  an  epi-continuity  result  for  a  certain  type  of  function  that 
we  shall  use  in  the  following  sections.  This  function  is  constructed  using  a 
multifunction  (multivalued  function),  to  model  the  situation  one  faces  in  dealing  with 
constrained  optimization.  If  T  is  such  a  multifunction  from  P  to  X,  we  say  it  is 
lower  semicontlnuous  (Isc)  at  a  pair  (Pq,Xq)  6  P  x  X  if  Xq  6  T(pq)  and,  for  each 
V  e  W(Xq)  there  is  some  U  €  W(Pq)  such  that  for  each  p  6  U,  V  n  T(p)  *5.  If  T  is 

Isc  at  (P()«Xq)  for  each  Xq  e  T(pq),  we  say  it  is  Isc  at  pq.  For  more  information  on 

this  latter  type  of  lower  semicontlnulty ,  see  (8);  however,  the  idea  of  lower 
semtcontinutty  at  (pQ,X0)  will  be  more  useful  to  us  in  what  follows.  This  type  of 
semicontinuity  seems  to  have  been  introduced  by  Doleckl  (3). 

The  following  lemma  relates  lower  semicontinuity  of  T  to  an  epi-semicontlnuity 
property  of  the  graph  of  T,  which  is  defined  to  be  the  set 

r(T)  {(p.x)  e  p  X  x|x  e  T(p)}  . 


For  a  set  S  C  p  x  x,  we  define  the  indicator  function  ifg  of  S  to  be 


il/g(p,x)  :  = 


0  if  (p,x)  e  S 
+“  If  (p.x)  ^  S 


LEMMA  2.9:  Let  T  be  a  multifunction  from  P  ^o  X,  and  let  (p^.xq)  e  graph  T. 

Then  't'r(T)  is  epi-usc  at  xg  if  and  only  if  T  is  Isc  at  (pg.Xg). 

PROOF  (if):  Suppose  T  is  Isc  at  (Pg.Xg).  let  V  6  W(xq),  and  find  (Ig  e  N(pg) 

so  that  if  p  e  Uf,  then  T(p)  n  v  If  p  6  Ug,  then  inf  ,{p,x)  =  0,  so 

“  xeN  ‘ ^ ' 

sup  inf  ♦r,_,(p.x)  =  0  , 


inf  sup  inf  'I’r/.pi (P»x)  =  0 

ue  Wpg)  peu  xev  ' 


As  V  was  arbitrary  in  W( Xg ) ,  this  implies 


°  =  *=  '^r(T)‘’'o’  “  *r(T)'Po'’'o’  ' 


^,r(T)  epi-usc  at  x  . 
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(only  if):  Suppose  'l'r(T)  epi-usc  at  Xp.  Let  V  6  W(Xq).  We  have 

°  "  *r(T)‘Po'’‘o’  i  ^\(T)‘’‘o>  ' 

so  in  particular 

lim  sup  inf  :|)j. (p,x)  S,  0  . 
p-Pp  xev 

However,  since  taltes  only  0  and  +*»  this  implies  that  for  some  U  e  WCpp)  and 

each  p  e  U,  inf  'I'r (P<’' )  ”  0-  But  this  means  that  there  is  some  x  e  V  with 
xev  ‘ 

x  e  T(p),  so  T(p)  nv  is  nonempty  for  each  p  e  Ut  that  is,  T  is  lower 
semicontinuous  at  (pp,Xp).  ■ 

The  next  proposition  gives  a  criterion  for  epl-upper  semicontinuity  of  a  function 
that  models  a  constrained  optimization  problem.  The  function  g(p,*)  represents  the 
objective  function,  while  T(p)  represents  the  feasible  set. 

PROPOSITION  2.10:  Let  g  :  P  *  X  +  (-“,+“1  and  let  T  be  a  multifunction  from  P 
to  X.  Define 

g(p,x)  if  X  e  T(p) 

f(p,x)  :«  • 

+»  if  X  ^  T(p)  . 

Assume  that  Xp  e  T(pp),  that  T  is  Isc  at  (Pg.Xp),  and  that  g  is  use  at  (pp.Xp) 
relative  to  graph  T.  Then  f  is  epi-usc  at  xp. 

PROOF:  We  have  f  -  g  +  +[■(.!.)•  Ae  (P0'*0^  ®  graph  T,  Lemma  2.9  implies  that 
'**r(T)  epi-usc  at  Xg.  However,  dom  ♦pjij.)  “  graph  T,  and  g  is  use  relative  to 

this  set.  The  hypotheses  of  Proposition  2.8  are  therefore  satisfied,  and  we  conclude 
that  f  is  epi-usc  at  Xg.  • 

In  this  section  we  have  presented  several  general  results  about  epi-semicontinuity . 
These  can,  in  turn,  be  used  to  derive  other  results  about  continuity  properties  of  infima 
of  functions  and  of  the  sets  of  points  at  which  those  infima  are  achieved.  Those  results 
are  dealt  with  in  Section  3. 
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3.  Infima  and  mlnimlzers  of  locally  ept-contlnuous  functions. 


In  this  section  we  relate  local  epi-cont inuity  properties  of  extended-real-valued 

functions  to  the  behavior  of  the  infima  of  those  functions  and  of  the  sets  of  points  at 

which  those  infima  are  attained.  Throughout  the  section  we  work  with  a  function 

f  :  P  X  X  +  R,  and  we  define  two  other  quantities  associated  with  f,  its  marginal 

function  ♦(p)  :=  inf  f(p,x)  (an  extended-real-valued  function)  and  its  set  of  minimizers 

xex 

*(p)  :=  {x  e  X|f(x,p)  J  i(i(p)) 

(a  multifunction  from  P  to  X).  Note  that  if  iKp)  =  +"  then  t(p)  =  x,  but  this  is 
misleading  since  in  actual  modeling  situations  we  do  not  want  to  consider  points  x  for 
which  f(p,x)  =  +".  We  shall  therefore  often  avoid  this  situation  by  requiring  that 
f(p,*)  be  proper  (never  -"  and  not  identically  +“). 

The  results  given  here  are  analogues  of  Corollaries  3.35  and  3.44  of  [8]  that  use 
local  hypotheses  instead  of  the  global  hypotheses  required  in  (8).  We  shall  see  in 
Section  5  that  the  local  hypotheses,  particularly  in  the  case  of  epi-upper  semicontinuity , 
can  be  easier  to  verify  than  global  ones. 

Our  first  result  deals  with  the  behavior  of  ^  when  an  epi-upper  semicontinuity 
requirement  holds. 

PROPOSITION  3.1:  Suppose  that  f  is  epi-usc  at  some  Xq  e  X.  Then 

f(pQ,Xg)  ^  lim  sup  tip)  . 

P^Pq 

PROOF:  The  epi-semlcontlnuity  assumption  implies  that 

f(Pn**n)  i  E*f(Xn)  =  sup  lim  sup  inf  f(p,x) 

0  °  ^  V-Wxq)  xev 

1  lim  sup  <)>  ( P )  I 

P*Po 

where  we  made  the  special  choice  V  =  X.  ■ 

Note  that  if  in  Proposition  3.1  we  had  taken  Xq  e  l>(pg),  then  we  would  have  found 
that  4  was  upper  semlcont Inuous  at  Pq,  since  then  ♦(Pq)  “ 
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We  now  develop  a  simple  crlterlo  ^or  the  multifunction  ♦  to  be  closed  at  pg, 

which  means  that  *(Pnl  ~  *(0),  where  ♦(U)  means  U  ♦(?)•  This  property 

ueN(Pp)  peu 

is  sometimes  called  upper  semicontinuity,  and  further  details  about  it  may  be  found  in  [81 

or  [4] .  To  establish  this  property  we  briefly  consider  an  extended  real  valued  function 

g(p,x)  on  P  X  X  and  its  associated  level-set  multifunction 

A^(p)  :=»  {x  €  x|g(p,x)  <  a) .  We  want  to  point  out  that  is  closed  at  pg  e  P  if  for 

each  X  e  X,  g  is  Isc  at  (pg.x).  To  see  this,  note  that  we  always  have 

A^<p  )  c:  n  cl  A9(u).  To  prove  the  opposite  inclusion,  suppose 

“  “  ueNipg) 

Xn  e  n  cl  A^(U).  Then  for  each  U  e  W(pg>  and  each  V  e  W(xg),  there  are  p  6  U 
“  ueNlpg)  “ 

and  x  e  V  with  g(p,x)  ^  a.  But  then  a  >  lim  Inf  g(p,x)  i  g(pg,Xg),  so 

(P/X)+(pQ,Xg  ) 

Xg  e  ^q(Pq)  snii  thus  A^  is  closed  at  pg.  This  observation  leads  to  the  following 
criterion  for  ♦  to  be  closed. 

PROPOSITION  3.2:  Let  f  :  P  x  X  +  (-“.+«■]  and  assume  that  f{pg,')  is  proper. 
Suppose  that  for  each  x  e  X  f  is  epl-lsc  at  x,  and  that  for  some  Xg  e  ♦(pg)  f  is 
epl-usc  at  Xg .  Then  ♦ ( Pg )  is  finite,  ♦  is  closed  at  pg ,  and  f ( p , • )  is  proper  for 
each  p  in  some  neighborhood  U  o£  pg . 

PROOF:  The  second  part  of  the  hypothesis,  together  with  Proposition  3.1,  implies 
that  ♦  is  use  at  pg,  and  therefore  the  function  g(p,x)  :«  f(p,x)  -  ♦(p)  is  Isc  at 
(Pq,x)  for  each  x  e  X  (via  Corollary  2.5).  Note  that  our  assumption  that  f(pg,*)  was 
proper  and  that  Xg  6  ♦(Pg)  implies  that  ♦<Pg)  is  finite.  Therefore,  by  upper 
semicontinuity  of  ^  we  have  <Kp)  <  for  all  p  in  some  U  B  ^(pg)>  and  so  for 
such  p  f(p,*)  is  not  identically  +*.  As  f  never  takes  -•  we  see  that  ftp,')  la 
proper  for  each  p  e  U.  In  particular,  this  means  that  g(p,')  is  well  defined.  Now  we 
just  observe  that  ♦  is  the  level-set  multifunction  A^  associated  with  g.  ■ 

Propositions  3.1  and  3.2  involved  upper  seroicontinuity  of  4  at  pg,  but  it  will 
also  be  convenient  to  have  a  criterion  for  lower  semicontinuity  there.  This  is  developed 
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In  the  next  proposition,  which  Imposes  a  somewhat  different  requirement  on  f:  there  is 
no  need  for  epl-upper  semicontinuity,  but  we  need  a  locally  uniform  compactness  condition 
on  the  level  sets* 

PROPOSITION  3.3:  Let  f  :  P  X  ♦  R.  Suppose  that  there  are  a  compact  set  K  C  X 

and  a  neighborhood  U  6  W(Pq)  such  that  ^  and  suppose  further  that  f  is 

epl-lsc  at  each  x  €  K.  Then  <<»  is  Isc  at  p^. 

PROOF:  If  ♦(Pq)  “  the  result  follows;  thus  we  may  assume  ♦  (Pq  )  ^  “**•  Let 

^  <  ‘^(pQ)!  X  6  K  then  f(pQ*x)  ^  ^  lower  semicontinuity  there  are 

V(x)  e  N(x)  and  U(x)  €  WCpq)  such  that  tf  (p' ,x*  )  e  Vtx)  x  U(x)  then  f(p',x*)  >  0. 

s 

As  K  Is  compact,  there  are  Xi,**.,x.  €  K  such  that  K  C  U  V(X{).  Let 

IS  '• 

s 

Uq  L  ^  0(x^)].  If  p  e  Uq  and  x  €  X  then  either  x  ^  K  (in  which  case 

f(p,x)  >  <P(Pq)  >  ti)  or  else  there  Is  some  i  with  x  e  V(x^).  As  p  e  U(x^)  we  have 
f(p,x)  >  B  in  this  case  too.  Thus  ^(p)  ^  B  for  each  p  e  Uq,  so  ^  Is  lac  at  Pq,  ■ 
Propositions  3.1  through  3.3,  as  well  as  the  results  of  (8),  deal  with  global  infima 
and  global  mlnlmlzers.  In  the  next  section  we  show  how  to  adapt  them  to  the  analysis  of 
local  minimization* 
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1.  stability  tn  local  minimization. 

In  thla  section  we  develop  a  set  of  criteria  for  persistence  and  stability  of  local 
mlnlolzers,  based  on  the  results  of  Section  3.  However,  to  apply  those  results  to  local 
Instead  of  global  minimization  we  need  to  define  In  suitable  generality  the  Idea  of  a 
local  mlnlmlzer.  In  particular,  to  obtain  the  results  that  we  want,  we  need  somehow  to 

make  sure  that  we  look  at  enough  mlnimlzers  near  where  we  are  working.  This  idea  ls  made 

precise  In  the  following  definition. 

DEFINITION  4.1:  Let  f  be  an  extended  real  valued  function  on  X.  A  nonempty 
subset  M  of  tf'  Is  a  complete  local  minimizing  set  (Cm  set)  for  f  with  respect  to  an 

open  set  6  D  M,  If  the  set  of  mlnimlzers  of  f  on  cl  G  Is  M. 

Note  that  In  thla  definition  the  function  f  must  take  the  same  value  at  each  point 
of  M,  and  that  value  must  be  strictly  less  than  the  value  assumed  by  f  at  any  point  of 
the  boundary  of  G.  If  M  happens  to  be  a  singleton,  It  la  usually  called  a  strict  local 
min Imlzer  of  g.  Of  course,  the  set  of  global  mlnimlzers  of  f  Is  always  a  complete 
local  minimizing  set  (take  G  X). 

Our  strategy  In  dealing  with  local  minimization  will  be  to  consider  a  parametrized 
function  f  :  P  X  X  *  1,  and  to  Impose  certain  hypotheses  upon  f  on  a  CLM  set  of 
f(Pg,*).  From  these  we  shall  then  draw  conclusions  about  local  mlnimlzers  of  f(p,*) 
for  p  near  pg.  It  will  be  convenient  to  state  the  hypotheses  In  the  language  of  epi- 
contlnultyi  In  Section  5  we  shall  show  how  to  translate  these  hypotheses  into  other  forms 
convenient  for  dealing  with  optimization  problesw  found  In  practice. 

For  some  of  our  results  In  this  section  we  shall  need  a  local  compactness  condition 
on  X.  Of  course,  an  ImsMdlate  example  of  a  situation  In  which  such  a  condition  holds  is 
the  case  of  optlsUzatlon  in  rT. 

The  next  proposition  essentially  adapts  the  results  of  Propositions  3.1  and  3.2  to 
the  case  of  local  minimization. 

PROPOSITION  4.2:  Let  f  be  a  function  from  P  *  X  ^  (-“,+“i  and  let  G  be  an 
open  set  In  X.  Define  for  p  €  P,  9(p)  :•  Inf^^^  5  f(p,x)  and 
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0(p)  lx  e  cl  G|f(p,x)  =  0(p)).  Assume  that  Q<Pq)  is  a  CLM  set  with  respect  to  G 
(i.e.,  C  that  £(pjj,")  is  proper,  and  that  f  is  epi-usc  at  some 

Xq  e  Q(Pg)  and  epi-lsc  at  each  x  e  cl  G. 

Then  ®(Pg)  is  finite,  6  is  use  at  pg,  0  is  closed  at  pg,  and  there  is  some 

U'  e  N(pg)  such  that  for  each  p  e  U’,  the  restriction  of  f(p,*)  cl  G  is  proper . 

PRCX3F:  Let  g  :=  f  +  q'  this  is  well  defined  since  neither  function  ever 

takes  Since  0(Pg)  ^  ^  have  0(Pq)  <  +“,  so  g(pg,")  is  proper.  Note  that 

g  is  epi-usc  at  Xg,  since  f  =  g  on  P  »  cl  G  and  (pg.Xg)  belongs  to  the  interior 
of  that  set.  since  xg  is  a  global  minimizer  of  g(PQ,‘)  and  0  is  the  marginal 
function  of  g.  Proposition  3.1  tells  us  that  0  is  use  at  pg.  Hence  there  is  some 

U  e  W(pg)  such  that  for  each  p  S  U  0(p)  <  +“,  and  therefore  0(p)  is  the  set  of 

global  mintmizers  of  g(p,*). 

Next  we  show  that  g  is  epi-lsc  at  each  x  6  X.  This  is  surely  true  if  x  ^  cl  G, 

since  then  g(p*,x' )  =  +"  for  any  p'  e  P  and  any  x'  near  x.  If  x  e  cl  G,  then 

since  g  J  f  we  have  by  epi-lsc  of  f, 

g(P0/X)  “  ffPo'**  i  f(p',x') 

(p* ,x* )»<pg,x) 

i  lim  inf  glp' ,x' )  , 

(p*,x' )*(pg,x) 

so  g  is  epi-lsc  at  x  by  Corollary  2.5. 

Now  applying  Proposition  3.2  (on  U  *  X),  we  conclude  that  0(pp)  is  finite,  0  is 
closed  at  pg,  and  g(p.*)  is  proper  for  each  p  in  some  neighborhood  U'  of  pg. 
However,  if  g(p,*)  is  proper  then  so  is  the  restriction  of  f(p,")  to  cl  G,  since  the 
two  functions  agree  whenever  the  second  vs  defined  and  since  g(p,’>  i  ♦“  off  cl  G.  ■ 

Proposition  4.2  is  relatively  weak  in  that  it  does  not,  for  example,  assert  the 
existence  of  minimlzers  for  p  ^  pg.  Indeed,  such  an  assertion  would  be  false  under  the 
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hypotheses  sssuned  there.  We  shell  therefore  strengthen  those  hypotheses  by  assuming  some 


ccBipactness  conditions,  and  with  the  new  hypotheses  we  shall  be  able  to  prove  a  much 
stronger  theorem. 

We  first  point  out  that  if  X  la  locally  compact  and  ^(Pq)  is  a  compact  CU4  set 

with  respect  to  some  open  set  G' ,  then  It  Is  possible  to  find  an  open  set  G  with 

0(Pq)  C  G  C  g' ,  such  that  cl  G  Is  compact,  tbus  In  the  statement  of  our  next  theorem 

we  can  suppose  with  no  loss  of  generality  that  cl  G  Is  compact.  To  see  why  this  is  so, 

let  us  associate  with  each  x  €  ^(Pg)  d  compact  neighborhood  V(x)  with  Int  V  C  G'.  As 

s 

0(p„)  Is  compact,  there  la  a  finite  set  x,,...,x_  with  G  s«  U  int  V(x. )  3  0(p„). 

U  IB  1*  1  ^ 

Then  cl  G  Is  compact,  and  ^(Pg)  remains  a  CLM  set  with  respect  to  G. 

THEOREM  4.3:  Assume  the  hypotheses  of  Proposition  4.2,  and  suppose  In  addition 
that  X  Is  locally  compact,  that  cl  G  and  G<Pg>  are  compact,  and  that  f  Is  Isc  on 
P  X  cl  G. 

Then  ®<Pg>  la  finite,  0  la  continuous  at  pg,  and  0  la  closed  at  pg. 

Further,  there  Is  some  U"  e  N(pg)  such  that  for  each  p  e  U*,  f(p,*)  restricted  to  cl 

G  Is  proper  and  0(p)  Is  a  nonempty,  compact  CLM  set  for  f(p,»)  with  respect  to  G. 

PROOF:  We  know  from  Proposition  4.2  that  9(Pg)  la  finite,  0  is  use  at  pg,  0  is 
closed  at  pg  and  f(p,*)  restricted  to  cl  G  Is  proper  for  each  p  In  some 
U'  e  M(pg).  Thus  t<e  need  to  prove  that  6  is  lac  at  pg  and  that  the  last  assertion 
about  0(p)  Is  true. 

To  prove  lower  semicontlnulty  of  0  we  observe  that  because  of  the  way  in  which  g 
was  defined  we  have  ^g(p  j'*"*  *"‘1  *'*  1®  1^®  proof  of  Proposition  4.2  that 

g  was  epi-lsc  everywhere  on  X.  Therefore  Proposition  3.3  applies,  and  we  conclude  that 
0  Is  lac  at  Pg,  hence  actually  continuous  there. 

For  the  last  assertion,  note  that  the  set  0(p)  is  nonempty  and  compact  for  each 
pep  since  f(p,")  is  Isc  on  cl  G.  To  complete  the  proof  we  show  that  for  some 

U"  e  N(Pq)  with  U"  c  u'  we  have  cl  0(U")  C  G»  then  surely  0(pl  Is  a  CLM  set  with 

respect  to  G  for  each  p  e  U" . 
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The  property  claimed  Is  certainly  true  If  G  •  X.  If  G  X  then  G  has  a 


boundary,  and  for  each  U  e  ^(Pq)  we  let  T(U)  be  the  Intersection  of  cl  0(U)  with  the 
boundary  of  G.  The  sets  T(U)  are  closed  subsets  of  the  compact  boundary  of  G,  But 
since  0  Is  closed  at  pg  we  have  9(Pg •  *  d  0(U),  which  Implies  that  the 

ueN(pjj ) 

Intersection  of  the  T(u)  Is  the  Intersection  of  OfPg)  with  the  boundary  of  G,  and 
this  latter  Intersection  Is  empty  since  ^(Pg)  ^9  9  CLM  set  with  respect  to  G.  It 

follows  that  there  Is  a  finite  family  In  ^(pg)  with  the  property  that 


t 

T(U, 

1=1 

)  =  ff. 

t 

If  we  define  U"  to  be  u*  n  (  n  U, ) ,  then  T(U"1 

1=1  ^ 

f  *  ^ ,  80  we  have 

cl  0(U") 

C  G. 

a 

In 

order 

to  apply  Theorem  4.3  to  a  specific  problem,  we  really 

need  to  know  only  four 

th ings : 

1) 

OlPg) 

Is  a  compact  CLM  set  with  respect  to  G, 

2) 

f(Pg, 

•)  Is  proper. 

3) 

f  Is 

epl-usc  at  some  Xg  e  0(Pg),  and 

4) 

f  Is 

Isc  on  P  X  cl  G. 

Properties  (2)  and  (4)  can  be  checked  using  Information  about  the  functions  appearing  In 
the  optimization  problem  being  solved.  Properties  (1)  and  (3)  are  usually  enforced  by 
making  regularity  assumptions  about  the  "base  case*  represented  by  pg.  In  the  next 
section  we  discuss  how  these  properties  can  be  obtained  In  a  typical  nonlinear  programming 
problem. 
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5.  How  to  verify  th«  hypotheses  of  *rh«or«m  4.3. 

In  this  ssctlon  we  show  how  to  apply  Theorem  4.3  to  a  typical  nonlinear  programing 
problem,  of  course,  there  are  many  other  types  of  problems  to  which  the  results  of  that 
theorem  can  be  applied,  but  this  application  will  serve  to  Illustrate  how  the  hypotheses 
of  Iheorem  4,3  can  be  verified  in  practice. 

The  problem  we  shall  consider  Is 

minimise^  e(p,x) 

subject  to  g(p,x)  ^  0  ,  (5.1) 

h(p,x)  ■  0  , 

X  e  C  , 

where  C  Is  a  closed  convex  set  In  tl',  Q  le  an  open  set  In  if',  P  Is  a  topological 
space  and  e,  g,  and  h  are  continuous  functions  from  p  «  0  Into  R,  ,  and  ifl 
respectively.  We  let  (Pq.xq)  6  P  x  fl  and  we  aasuae  that  for  each  p  e  P,  g(p,* )  and 
h(p,*)  are  Frichet  differentiable  on  fi.  First  derivatives  of  g(p,* )  and  h(p,* ) 
with  respect  to  x  will  be  denoted  by  g^(p,*)  and  h^(p,>).  We  assume  that  the 
functions  g^  and  h„  are  continuous  at  (pq.xq). 

Suppose  now  that  (5.1)  has  a  local  mlnlmlser  at  Xg  when  p  •  pg.  We  are  Interested 
In  conditions,  preferably  verifiable,  under  which  we  can  apply  Theorem  4.3  to  (5.1)  to 
gain  Information  about  local  minimisation  In  (5.1)  when  p  varies  near  pg.  In  order  to 
develop  such  conditions,  we  first  define  an  essential  objective  function 
f  !  P  X  nf  ♦  (-",♦•1  by 


f (p.x) 


e(p,x)  If  X  e  C  n  i),  g(p,x)  i  0  and  h(p,x)  •  0 


(5.2) 


(  +*•  otherwise  . 

We  note  that  f  Is  evidently  Isc  on  P  «  SI,  and  f(pg,*)  Is  proper.  Next  we  malte  two 
)(ey  assumptions  about  (5.1).  These  are  explained  In  detail  In  the  next  two  paragraphs. 

The  first  assumption  we  shsll  make  Is  that  the  constraints  of  (5.1)  are  regular  at 
Xg  for  p  -  Pg.  This  means  that 
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0  e  Int  j 

g(pg,Xo) 

gx(po-xo  >] 

1 

1 

1 

1 

h(pg,Xo) 

+ 

h^iPO/Xg)! 

(C  -  Xg)  + 

(0)<1 

if  C  happens  to  be  sT  then  (5.2)  is  just  the  well  known  Mangasar ian-Fromovitz 
constraint  qualification.  Various  properties  of  regularity  are  treated  in  (5)  and  17];  in 
particular,  it  is  shown  in  [5,  Th.  1)  that  if  we  define  a  multifunction  T  :  P  ♦  u"  by 
T(p)  :=  {x  e  C  r.  n|q(p,x)  i  0,  h(p,x)  =  0}  , 
then  the  hypothesis  of  regularity  (5.3)  implies  that  T  is  lower  semicontinuous  at 
(Pq,Xq).  This,  together  with  Proposition  2.11  above  and  the  fact  that  e{p,x)  is 
continuous,  permits  us  to  conclude  that  the  essential  objective  function  f  defined  in 
(5.2)  is  epi-usc  at  Xq. 

Our  next  assumption  is  that  the  level  set  of  f(pp,*)  corresponding  to  f(pg,XQ)  is 
compact  and  is  contained  in  i).  Specifically,  we  assume  that  there  is  an  open  hounded 
set  U  with  cl  U  C  a,  such  that  if  x  e  (C  n  Q)\u  with  g(x,p(j)  i  0  and  h(x,pQ)  =  0, 
then  e(x,pQ)  >  e(XQ,pg):  that  is,  any  feasible  point  of  (5.1)  (with  p  =  pg)  that  does 
not  belong  to  U  gives  a  worse  value  of  the  objective  function  than  does  Xg.  We  also 
assume  that  Xg  is  indeed  a  minimizer  of  f(pg,*)  with  respect  to  cl  U:  that  is, 
that  U  is  a  CLM  set  for 

One  way  of  ensuring  that  this  assumption  holds  is  by  assuming  the  existence  of  second 
derivatives  and  invoking  the  generalized  second-order  sufficient  condition  introduced  in 
16).  In  that  case  we  know  from  (6,  Ih.  2.2]  that  we  can  take  U  to  be  a  suitably  small 
neighborhood  of  Xg,  and  that  there  will  then  exist  some  positive  u  with  the  property 
that  for  each  x  in  u  that  is  feasible  for  (5.1)  (with  p  =  Pg ) ,  one  has 

e(pg,x)  i  e(pg,Xg)  +  lilx  -  Xpl^  .  (5.4) 

However,  there  are  also  many  less  stringent  hypotheses  under  which  the  assumptions  of  the 
last  paragraph  hold.  For  example,  if  the  function  f(pp,-)  is  convex  then  we  need  only 
assume  that  it  has  a  compact  level  set  corresponding  to  f(pg,Xg),  since  the  local 
minimizer  Xg  will  then  necessarily  be  global  and  hence  a  CLM  set  (J  will  exist. 
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Mlth  the  above  assumptions,  the  function  f  will  satisfy  the  hypotheses  of  Theorem 
4.3.  We  can  therefore  conclude  Immediately  from  that  theorem  that  for  each  p  In  some 
neighborhood  of  Pq  the  nonlinear  optimization  problem  (5.1)  has  a  local  mlnlmlzer  In 
(J:  In  fact,  the  set  of  such  local  mlnlmlzers  will  be  a  nonempty,  compact  CLM  set  with 
respect  to  U.  (Of  course,  for  a  convex  problem  this  will  be  the  global  minimizing 
set.)  Further,  that  set  will  be  closed  at  Pq  as  a  multifunction  of  p,  and  the  locally 
optimal  objective  value  will  be  continuous  at  Pq.  Thus,  In  this  case  the  verlf ii-atlon  of 
the  hypotheses  of  Theorem  4.3  Involves  two  familiar  tools  of  nonlinear  programming:  a 
suitable  constraint  qualification  and  a  compactness  condition  on  the  level  sets  of  the 
essential  objective  function.  These  conditions,  moreover,  have  to  be  satisfied  only  by 
the  unperturbed  problem  with  p  =  Pq,  and  conclusions  about  the  perturbed  problem  for  all 
small  perturbations  will  Immediately  follow. 
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